A moodboard is a great way to visualize any creative project. Add images to the grid for inspiration!
Problem
Only classification data.
Poor data with less quality images.
Synthetic Prompt generations
Create close to real user prompts in their pet diagnostic.
Output with all possible solutions and detection in a well structured response.
Design and research
Image
+
Potential Prompt
Current Dataset we have
Just a raw image
Label ?
Only classification
one word labels
Steps for synthetic data generation
+
(Prompt for the AI agent to create user specified prompts for real world cases.)
=
Light weight model which can detect and generate high quality prompts.
Gemini 2.0 Flash
+
The Issue with the pet (label from the dataset)
+
Symptoms
Home remedies
Prevention
Emergency Relief
Vet required or not
Data needed to be gathered from more dataset for different diseases and symptoms.
Our final output(assumed) which will be used as a training output for the model
Gemini 2.0 Flash
Light weight model which can matches the disease and its details like symptoms etc and generate high quality prompts with solution.
Original user prompt explaning the image
+
+
=
Final Dataset
+
Contains Image + User Query about their pet in a humanized prompt
Well crafted detected results and suggestions for the issue(disease in this case).
GPT will train on this structured and cleaned dataset for better results.
+
Cloud API
What is wrong with my dog??
Rough working of fine tuned LLM
Select to edit this rectangle.
Select to edit this Text.
Select to edit this Shape text.
Select to edit this Select to open this link..
Select to edit this Image.
Select to edit this Handwriting.
To edit the text content of this object, select the object again. For other actions, navigate to the context menu or use the arrow keys to move, resize or rotate the Text.
Type here to edit the text.
Select to edit this star reaction.
To edit this star reaction, navigate forward to the context menu or use the arrow keys to move, resize or rotate it.
To edit this rectangle, navigate forward to the context menu or use the arrow keys to move, resize or rotate it.
To edit the text content of this object, select the object again. For other actions, navigate to the context menu or use the arrow keys to move, resize or rotate the Shape text.
To edit this Image, navigate forward to the context menu or use the arrow keys to move, resize or rotate it.
Select to edit this Text.
Select to edit this arrow.
To edit this arrow, navigate forward to the context menu or use the arrow keys to move, resize or rotate it.
To edit this Handwriting, navigate forward to the context menu or use the arrow keys to move, resize or rotate it.